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ABSTRACT 

The biologically-inspired swarm paradigm is being used to 
design self-organizing systems of locally interacting artifi- 
cial agents. A major difficulty in designing swarms with 
desired characteristics is understanding the causal relation 
between individual agent and collective behaviors. Math- 
ematical analysis of swarm dynamics can address this dif- 
ficulty to gain insight into system design. This paper pro- 
poses a framework for mathematical modeling of swarms 
of microscopic robots that may one day be useful in med- 
ical applications. While such devices do not yet exist, the 
modeling approach can be helpful in identifying various de- 
sign trade-offs for the robots and be a useful guide for their 
eventual fabrication. Specifically, we examine microscopic 
robots that reside in a fluid, for example, a bloodstream, 
and are able to detect and respond to different chemicals. 
We present the general mathematical model of a scenario in 
which robots locate a chemical source. We solve the sce- 
nario in one-dimension and show how results can be used to 
evaluate certain design decisions. 

1. INTRODUCTION 

Swarm Intelligence is a relatively new concept for design- 
ing multi-agent systems |4|. Swarms are decentralized sys- 
tems composed of many simple agents with no central con- 
troller. Instead, swarms are self-organizing: constructive 
collective behavior emerges from local interactions among 
the agents and between agents and their environment. Self- 
organization is ubiquitous in nature: Aggregation into multi- 
cell organisms in Dictyostelium discoideum colony, trail for- 
mation in ants, hive building by bees, and mound construc- 
tion by termites, are a few examples. The success of these 
organisms has inspired the design of distributed problem- 
solving systems. 

A major difficulty in designing self-organizing swarms 



with desired characteristics is understanding the causal rela- 
tion between individual agent characteristics and collective 
behavior. One approach is experiments with real agents, 
e.g., robots, to evaluate behavior under real conditions. How- 
ever, fabricating enough agents to exhibit swarm behavior is 
often too expensive or not feasible with current technology. 
Simulations, such as sensor-based simulations of robots, are 
usually much faster and less costly than experiments. But 
these require good models of the robots and their environ- 
ments, which are often not yet available. Moreover, sim- 
ulations still require many repetitions to systematically ex- 
amine consequences of various choices for individual agent 
behaviors. 

Mathematical modeling and analysis offer an alternative 
to the time-consuming and costly experiments and simula- 
tions. Mathematical analysis can be used to study swarm 
dynamics, predict long-term behavior of even very large 
systems, and gain insight into system design: e.g., how indi- 
vidual agent characteristics affect the swarm behavior Such 
analysis can suggest parameters that optimize group perfor- 
mance, prevent instabilities, etc. These particular choices 
could then be examined in more detail through simulations 
or experiments. 

This mathematical approach is particularly useful for 
preliminary evaluation of design trade-offs for robots that 
cannot yet be built and will operate in poorly characterized 
environments. As one such application, robots with sizes 
comparable to bacteria ("nanorobots") could provide many 
novel capabilities through their ability to sense and act in 
microscopic environments. Of particular interest are medi- 
cal applications, where robots and nanoscale-structured ma- 
terials inside the body could significantly improve disease 
diagnosis and treatment I9l ll9ll20lll5l . Typically, each such 
robot will have dimensions of a few microns so could read- 
ily travel through even the tiniest blood vessels, will be able 
to communicate with other robots (e.g., using ultrasound) 



over distances of about 100 microns, and will consume in 
the range of 1 — 1000 picowatts. 

An example task for such robots operating in the blood- 
stream is to aggregate and form structures at locations with 
specific patterns of chemicals. Initially, as robots move pas- 
sively through the fluid, monitoring for the chemical pat- 
tern, they need to avoid disturbing the flow. Thus they will 
be at low density, i.e., with typical separation between neigh- 
boring robots many times larger than their size. On the other 
hand, to affect the environment, many robots will need to 
act together (e.g., to block flow in blood vessels feeding 
populations of cancer cells or to aid in repairing damaged 
tissues by forming suitable scaffolding). Thus the swarm 
must change to a higher density of robots, in spite of lim- 
ited communication ranges. In this denser configuration, 
communication among neighbors is easier, and simple local 
controls allow forming a variety of structures either static or 
dynamically responding to changing forces in the environ- 
ment, as proposed in the context of large self-reconfigurable 
robots 1 3 24 1 . To quantify this example, a swarm could con- 
sist of around 10^^ machines, vastly more than in swarms 
of larger devices. Even such a large number of machines 
would have a total mass of only about one gram, and a oc- 
cupy less than 0. 1% of the typical blood volume of an adult, 
compared to the 20 — 40% occupied by cells. 

While fabricating such machines is beyond the ability of 
current technology, the rapid progress in engineering nano- 
scale devices should eventually enable their production. For 
example, ongoing development 1 121 11011181 of molecular- 
scale electronics, sensors and motors provides components 
for such robots, though these cannot yet be assembled into 
large numbers of complete systems. Programmable bacte- 
ria 1251 give large numbers of functioning microscopic sys- 
tems, and separate DNA computers can respond to Boolean 
combinations of chemicals in their environment |2|. How- 
ever relying on biological organisms restricts the robots' 
material properties and, by using protein synthesis to per- 
form logic operations, limits the computational complexity 
and speed of control programs. 

Beyond the challenge of fabricating the robots is de- 
signing and analyzing controls suitable for their physical 
environments, tasks and capabilities, whose features differ 
considerably from those of larger robots. Fortunately, we 
can evaluate control methods prior to building the robots 
with theoretical studies 1 7 , 9 23 1 characterizing robot ca- 
pabilities and their task environments. Moreover, suitable 
control programs can compensate for some hardware lim- 
itations (e.g., limited available power or sensor accuracy). 
Thus studies of control approaches can identify useful tasks 
for robots with limited hardware capabilities, as may arise 
before the fabrication technology is fully mature. 

This paper extends the stochastic processes framework 
developed for modeling teams of larger robots and that has 



been applied successfully to a number of robotic applica- 
tions 1 17|. Our work complements other theoretical studies 
of microscopic robots 1 5 23 1 1 1 by providing a methodol- 
ogy for studying collective swarm behavior. It can also be 
applied to larger robots that implement chemotaxis as the 
basis for movement in an external field 1 6 1 . While compari- 
son with microscopic experiments must await the technical 
feasibility of fabricating microscopic robots, our mathemat- 
ical model can be used to evaluate various design trade-offs 
for the robot capabilities that can achieve the same swarm 
performance and can be a useful guide to eventual fabri- 
cation by allowing designers to focus on combinations of 
hardware capabilities easiest to fabricate. 

Below we present a general model of the dynamics of 
a swarm of microscopic robots that are interacting with an 
external field. In Section |3l we motivate the approach by 
describing a medically relevant scenario that considers a 
swarm of microscopic robots moving in a fluid to localize a 
chemical source. In Sectionl^we solve a one-dimensional 
model and analyze different design choices. We conclude 
the paper with a discussion of the approach and results. 



2. STOCHASTIC THEORY OF 
SPATIALLY-DEPENDENT PROCESSES 

Previously, we developed a framework based on stochas- 
tic Master Equation for mathematical analysis of homoge- 
neous robotic swarms [13" '161. Specifically, consider an 
agent whose controller is an automaton consisting of L lo- 
cal states. We then assume the overall system is sufficiently 
well-described by an occupancy vector n = {ni,n2, ■■■riL), 
where Uk is the fraction of agents in state k. That is, we 
need only consider the number of agents in each state rather 
than tracking their individual identities. In designing sys- 
tems where typical or average behavior is of primary inter- 
est, it is useful to characterize the system by a probability 
distribution P(n, t), which is the probability the system is 
in configuration n at time t, and evolves according to the 
Master Equation 1141 . This distribution characterizes the 
behaviors of an ensemble or multiple independent instances 
of the swarm. When most such instances have nearly the 
same behavior, ' fluctuations among different instances can 
be neglected, and the average occupancies fik provide a suf- 
ficient characterization of the system. The average fraction 
of agents in state k then evolves according to 



duk 

~dr 



E 



Wjkrij - rik 



^Wkj 



(1) 



' Consider, for example, a swarm consisting of a large number of agents, 
each independently executing the same controller. Then, by the law of large 
numbers, behaviors of different instances of this swarm would be nearly 
identical. 



with Wjk the transition rates between the states j and k. 
Note than in general Wjk might depend on the fraction of 
agents in particular states, i.e., average occupancy vector n. 
Eq.^governs the evolution of the collective behavior of the 
system. 

While this approach works well for many spatially uni- 
form systems 1171 . it is too coarse-grained for systems with 
a spatial correlation in agents' interactions. Thus, it is not 
sufficient to describe, for example, an ant-like swarm where 
agents interact through evolving chemical fields or micro- 
scopic robots monitoring chemicals released into a fluid. 
These situations require a generalization of the Master Equa- 
tion, in which each robot not only has a discrete controller 
state k but also a continuous coordinate x (i.e., its spatial 
location). As with the original formulation, we suppose the 
number of agents in each state is sufficient to determine the 
collective behavior of interest. Because x is a continuous 
variable, these counts become densities leading us to intro- 
duce fife(x, t) as the average robot fraction density in state 
k at location x and time t. Thus a small volume Ax around 
location x contains, on average, the fraction 7ia:(x, t)Ax of 
the robots in the system. 

Let us consider a system where agents interact with the 
environment through a certain external chemical field. Let 
us also assume that agents are able to interact through stig- 
mergy by releasing a special chemical into the environment 
that we call communicative signal. We denote p(x, t) and 
c(x, t) concentration of the chemical and communicative 
signal, respectively, at point x at time t. Then we can write 
down the generalized rate equation as follows: 



dt 



nk 



dx' ^ Wjk (x, x'; p, c)nj (x', t) (2) 
i 

(x, t) / dx' ^ Wkj (x, x'; p, c) . 



tion rates. Communication among nearby robots, e.g., with 
ultrasound, allows the robots to reduce noise in estimating 
chemical gradients and hence perform better than individ- 
ual robots or bacteria 1 1 1, but at a cost of additional power 
use for the communication. Robot motion, either moving 
passively with the fluid or using powered locomotion, e.g., 
to follow chemical concentration gradients, also contributes 
to the transitions. 

While Equation|2]is a general description of the overall 
system behavior, it is too complex in its present form to be 
useful. Fortunately, it can be simplified considerably into a 
more intuitive form by noting that in many physically real- 
istic situations agents' motion can be decoupled from state 
transitions, so that the transition rate can be represented as 



Wjk = (5jfcVKfc(x,x';/7(x),p(x'),c(x),c(x')) 
+ S{x ~ x')wjk{p{'x.), c(x)) , 



(3) 



where djk is Kroenecker's symbol^ and S{x) is its continu- 
ous analogue (5-function. In other words, during a transition 
between two discrete states we neglect the change in robot's 
position. In Eq.|3lVFfe is an appropriately chosen kernel that 
describes agents' motion (as index k indicate, it can be dif- 
ferent for each state), while the second term describes tran- 
sition between discrete states. 

Equation|3]allows us to separate transition function into 
terms with purely spatial transitions and terms with purely 
state transitions. Indeed, using Eq. |3]we can decouple the 
agents' kinematics from the state transitions between dis- 
crete state and rewrite Eq.|2]as follows: 

dnk{x,t) n - I \ v^ / \- I \ /^N 
= £fcnfc(x,t) + 2_^w;jfe(p, c)nj(x,t) (4) 

3 

- nk{x,t)'^Wkj{p,c) 



Now the transition rates Wjk depend not only the state in- 
dices j and k and occupation vector but also on the spatial 
coordinates and concentration of the chemical at the corre- 
sponding points. Note also that we have included the depen- 
dence of the transition rates on x and x' explicitly to account 
for agents' kinematics even in the absence of chemical and 
communicative concentrations (e.g., to describe freely dif- 
fusing agent). 

The transition rates it;jfc(x, x'; /9(x),c(x)) summarize 
the behaviors of the individual robots. For example, the 
robot's internal state could change when it detects a chem- 
ical concentration above a predetermined threshold. In ap- 
plications of microscopic robots, such detections will often 
involve a relatively small number of molecules (e.g., on the 
order of tens) so stochastic fluctuations in the number de- 
tected will be a significant source of sensor noise and can 
be included as a range of new states with nonzero transi- 



Here Ck is an operator (specified below) that describes the 
motion of agents in state k. The second and third terms 
in Eq. 0] describe agents state transitions. Note that now 
Wjk{p, c) depends on spatial coordinates indirectly, through 
concentration p(x, t) and c(x, t). When the concentrations 
p and c are constants, Eq.^is recovered by integrating Eq.0] 
over the spatial coordinates x, assuming that Ck preserves 
the number of agents in state k (e.g., no absorbing bound- 
aries) so that integral over the first term in Eq.|4]vanishes. 

To specify the operators Ck, we note that for the par- 
ticular environment we are interested in, (i.e., microscopic 
robots operating in a fluid) robots' motion can be described 
by a diffusion equation [141. In this paper, we study chemo- 
tactic robots that respond to a chemical and signalling fields 



-Kroenecker's symbol is defined as follows: 5ij = 1 if i = j and 



by propelling themselves in the direction of increasing con- 
centration. This capability is modeled after bacterial chemo- 
taxis which allows these single cell organisms to efficiently 
move towards food sources and away from noxious sources. 
Although in some cases the exact derivation from the mi- 
croscopic transition rates is feasible, if very involved (see, 
for example, 1211 |8l for treatment of bacterial chemotaxis 
which can be treated as a biased random walk), chemotaxis 
in a chemical concentration field p(x, t) is usually intro- 
duced into the rate equations phenomenologically by pos- 
tulating a chemotactic velocity as Vd = ripWp{:x., t), where 
rjp is the so called chemotactic sensitivity (which may itself 
depend on p). One can then write for operators Ck 

/Ifc = Z?fc V2 - V V - V • [V^ (p, Vp) + V^ (c, Vc)] (5) 

Here, Dk is the diffusion coefficient of agents in state k as- 
sumed to be a constant, v is the flow velocity, and V^ and 
V^ are the chemotaxis drift velocities of robots due to con- 
centration gradients of the chemical and the communicative 
signal, respectively. 

To proceed further, we should also define how the chem- 
ical and concentration fields evolves in time. As an example 
relevant for microscopic robots, we consider the evolution 
of this fields in a moving fluid in which the robots operate. 
The evolutions of p(x, t) c(x, t) are governed by the diffu- 
sion equation: 

-£ = Dp\/^p~v-\/p-jpp + Qp{K,t) (6) 

= ZJcV^c-v- Vc-7cC + ^qfenfc(x,t) (7) 

k 



dt 



In Eq.|6lthe terms on the right describe, respectively, the 
diffusion of the chemical (with a diffusion constant Dp), the 
advection of the chemical due to fluid motion with velocity 
V, the decay of the chemical at rate jp, and its deposition 
by sources with intensity profile Qp{x, t). Terms in Eq. 
have similar meaning, except the deposition rates of sig- 
nalling chemical is proportional to the fraction of agents in 
state fc, nfe(x, t) (note that, generally speaking, the coef- 
ficients Qk themselves depend on the fraction of agents in 
state k). The parameters in this equation could, in general, 
depend on space and time, as well as the location of the 
robots (e.g., a sufficiently high concentration of the robots 
could significantly affect the fluid flow). For simplicity, we 
will treat them as constants. For microscopic robots, fluid 
motions will usually be at very low Reynolds number so 
the fluid flow will be laminar with the velocity v chang- 
ing smoothly with location. Viscous forces dominate the 
motions of such robots with requirements for locomotion 
mechanisms and power use quite different from experiences 
with larger robots II22I . 

Note that the system of Eqs. |4] |6land0can be easily 
generalized to handle multiple chemicals with different dif- 



fusion coefficients. Another generalization would allow a 
variable number of agents in the system, in which case we 
would add a variable for the total number of agents in the 
system at time t to the variables introduced above describ- 
ing the fraction in various states. 

Equations|4jQtogether with appropriately chosen boun- 
dary conditions describe time evolution of the system. In the 
next section we use this formulation for a prototypical task: 
finding and localizing at the source of a chemical released 
into a flowing fluid. 

3. TARGET LOCALIZATION WITH 
MICROSCOPIC ROBOTS 

Let us consider a D-dimensional volume with multiple tar- 
gets that release certain chemical into the environment. The 
task of the microscopic swarm is to aggregate at these tar- 
gets in order to carry out some actions in the vicinity of 
the targets. This capability is fundamental to many medical 
applications envisioned for these microscopic robots. For 
example, the volume of fluid may be a blood vessel that has 
been damaged. Robots are required to aggregate at the in- 
jury site in order to assist in healing, forming clots, etc. 

We consider a simple robot controller that on a high 
level can be thought to consist of 3 discrete states described 
below: 

State 1 (search): Do a biased random walk in the direction 
of the communicative signal concentration gradient. 

State 2 (communicate): Move towards the chemical source 
following the concentration gradient of the target chem- 
ical and release communicative signal to other robots. 

State 3 (disperse): Move away from the target in the direc- 
tion opposite to the target chemical's concentration 
gradient for some specified time r. 

To fully specify a robot's behavior, we also have to de- 
scribe the transitions between these states. The robots start 
out in State 1, the searching for targets using random diffu- 
sive motion and following the gradient of the communica- 
tive signal. Once the concentration of the target chemical 
at a certain point in space is sufficiently high the robot at 
that point will switch to the State 2: it will start moving 
towards regions of high concentration (using biased diffu- 
sion or gradient following) while releasing a new chemical 
which acts as a communication signal to attract other robots. 
With some probability (that can be fixed, or dependent on 
the concentration of the robots at the source), robots in the 
State 2 will switch to State 3, where they will disperse from 
the source, moving in the direction opposite to the gradient. 
Finally, robots in the State 3 will switch to the searching 
state with probability 1/r. The last behavior ensures that 



robots will not be stuck at local maxima of the chemical 
potential. 

Let denote by rii (x), n2 (x), n^ (x) the fraction of robots 
in each state at point x, with normalization condition 

/ dx(ni{x) + n2(x) + 7i3(x)) = 1. 

Let p{x) and c(x) be the concentrations of the chemical re- 
leased from the targets and the communicative signal re- 
leased by robots in State 2. We also denote by V^ and V|) 
the robots' drift velocity in the concentration gradients of 
chemical (released by the targets) and communicative sig- 
nal (released by the robots), respectively. Then the set of 
equations describing the evolution of the system is as fol- 
lows: 



dni 



DiV^ni - V • Vni - V • [V^rii] 

r 
-^ = i?2V2ri2 - V • Vn2 - V • [V^n2] 
+ niF{p) -G{n2,p,c)n2 



^ = D3 W^ - V • Vn3 + V • [V^na] 



+ G(n2,p, c)n2 



ns, 



(8) 



(9) 



(10) 



where F{p) is the concentration-dependent transition rate 
from State 1 to State 2, G(rt2 ; p; c) is the transition rate from 
State 2 to State 3, and 1/t is the probability that a robot in 
State 3 will switch to State 1. 

Equations IStilOl have a simple intuitive interpretation. 
The first two terms in Eq.|8]describe robots motion in State 
1 : diffusive searching and following communicative signal, 
if present. The third term describes the drift in the flow. The 
fourth term describes transitions to State 2 at the rate F{p), 
which depends on the concentration of the target field. The 
last term describes transition of robots from State 3 to State 
1 after the robots have moved in the direction opposite to the 
concentration gradient for a period of time r. G{n2 , p, c) is 
the rate at which robots transition from State 2 to State 3, 
and it could in principle depend on the local concentrations 
of the gradients, as well as the number of agents present at 
the target site, for example, when presence of a certain min- 
imum number of robots is required for executing an action. 

We have to complement these three equations with two 
more to account for the evolution of chemicals p and c, that 
are obtained from Equations ??,?? and ?? as follows: 



dp 



M 



= DpV'^p -y-Vp + Y^ QiS{x - Xi) - 7pp (11) 



i=l 



In Eq.f^Xi-s, i = 1, 2, ..M are the locations of the target 
sources, Qi is the intensity of source i, and 7^ is the decay 
rate of the target chemical. Similarly, in Eq.^]gc is the in- 
tensity of communication signal released by a robot in State 
2, while 7c is the decay rate of the signal. 

4. RESULTS FOR A SIMPLIFIED ID SCENARIO 

In this section we present results for a 11? geometry and a 
single target scenario. We consider the case when the liquid 
flow is very slow compared to other time scales so we can 
set V = 0. Also, since there is only one target, we neglect 
the third (dispersing) behavior so that two possible states 
are State 1 ("search") and State 2 ("communicate"). The 
target is located at a; = 1 and serves as a point source for 
the chemical. We assume that the diffusion of the chemi- 
cal happens much faster compared to robots' diffusion, and 
it quickly reaches its steady state profile. Hence, the equa- 
tion for evolution of p{x, t) can be solved separately, with a 
solution 

p{x,oo) = p{x) = goe-V'/p/'Dp(i-=^),o< x<l. (13) 

For the results presented here we used Qo — 0.1, Dp — 0.2 
and 7p = 0.5. 

AU robots start at State 1 and are initially localized at 
X = Q. We assume that a transition from State 1 to State 
2 happens whenever a robot in State 1 detects the target's 
chemical above a certain threshold level po, so that the tran- 
sition rate is F{p) = 9{p — po), where d{x) is the step 
function, 0{x) = 1 if x > and e{x) = 0, a; < 0. While 
in State 2, robots move in the chemical gradient with a con- 
stant drift velocity Vd and release a communicative signal 
with intensity Qc- 

To proceed further, we need to specify the dependence 
of the drift velocity in State 1 on the concentration of com- 
municative signal c. Again, we assume that once a robot 
detects communicative signal above certain threshold cg, it 
propels itself through the fluid in the direction of the gra- 
dient with a constant drift velocity Vd- Then the dynamics 
of the system is described by the following system of equa- 
tions: 



dni 

~dr 

dn2 

dt 

dc 

di 



D, 



= Dn 



-^ ^ D, 



dx'^ 
9^n2 
dx'^ 

dx"^ 



Voe^c-co) 

dn2 



dni 



ax 



dx 
F{p)ni 



F(p)ni(14) 
(15) 
(16) 



— - = DcV'^c - V • Vc + gc"2 - 7cC 
at 



(12) 



To study the effect of different design parameters on ag- 
gregation behavior of the robots at the target, we solved the 
system Ea.ll4l-[T6lnumericallv. We used the following pa- 
rameters (in dimensionless units): Z3„ = 0.01, Dc = 0.05, 



Vd = 0.1, Qc = 0.1, 7c = 0.01. For the detection thresh- 
olds we used cq = 0.001 and po = 0.01, the later assuring 
that that robots detect the chemical approximately midway 
in the interval [0, 1]. We used reflective boundary condi- 
tions for Til and n2, dni/dx\o^i = dn2/dx\o^i = 0, and 
absorbing boundary conditions for c, c(0) = c(l) = 0. 

In Fig.^we plot the spatia-temporal evolution of robots' 
densities with and without communication. Clearly, the den- 
sity peak at a; = 1 is stronger for the system with commu- 
nicative behavior. This suggests that communication indeed 
helps the robots to aggregate better In addition, the ag- 
gregation process with communication happens faster than 
without communication. This is also shown in Fig.|2j where 
we plot the density of robots at x = 1 as a function of time 
for three different cases: free diffusion^ (Vd = 0), gradient 
following without communication (Vd ^ Q,qc ~ 0), and 
gradient following with communication (Vd, Qc y^ 0). As it 
can be seen from Fig. 121 the systems with gradient follow- 
ing and communicative behavior do demonstrate aggrega- 
tive behavior, and it is more pronounced for the system with 
communication. For instance, at time t — 10 the robot den- 
sity at a: = 1 and with communication is more than 3 times 
higher than in the non-communicating case. 

One of the design objectives is to have robots aggre- 
gate at the target fast enough, while at the same time not 
dissipating too much power due to the propelling. To ex- 
amine this tradeoff, let us consider the dependence of the 
aggregation time (defined as time needed for fraction no of 
robots to reach the vicinity of the target which we define 
as the interval [0.95, 1],) on the drift velocity Vd- In Fig.|3l 
we plot aggregation time vs Vd for three different values 
of no. One observes that if increasing the drift velocity 
from Vd = 0, the aggregation time decreases monotoni- 
cally, with a steeper decline for larger no. However, it soon 
"saturates", so that increasing Vd further has very small ef- 
fect on the aggregation time. This is because for large val- 
ues of Vd/_D„, the aggregation time is mainly dominated 
by time required for robots to diffuse and detect chemical 
gradient, and increasing Vd clearly does not have any effect 
on this time. Hence, depending on the desired number of 
robots in the vicinity of the target, as well as the required 
aggregation time, the best strategy for robots might be to 
have a moderate drift velocity. Note that this type of anal- 
ysis can be used to assess the energy-efficiency of various 
behaviors since power required to propel a robot through a 
fluid with velocity Vd scales with Vd- 
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Figure 1 . Time evolution of robot densities without commu- 
nication (a) and with communication (b) 
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'Note that the absence of aggregation for free diffusing robots is due to 
reflective boundary conditions at the source for ni and n2. If one employs 
absorbing boundary conditions instead, robots will demonstrate aggrega- 
tive behavior even with free diffusion. 



Figure 2. Time evolution of robot densities at a; = 1 for 
three different strategies 




Drift Velocity V^ 

Figure 3. Aggregation time as a function of drift velocity, 
for three different values of no. 



5. DISCUSSION 

Microscopic robots face physical environments quite differ- 
ent from our experience with larger robots. In particularly, 
many interesting tasks for such robots will involve interac- 
tion with spatially varying fields, such as chemical concen- 
trations. In this paper, we showed how to incorporate such 
fields into a previously proposed approach relating individ- 
ual robot behaviors to that of the population as a whole. 
The analytic framework readily incorporates Brownian mo- 
tion and viscous fluid flow. The framework also applies to 
macroscopic robots programmed to emulate behavior of mi- 
croscopic organisms — for example, chemotaxis [6J. 

As future work, it would be interesting to examine more 
realistic scenarios, involving three-dimensional fluid flow in 
vessels with quantitatively accurate physical parameters for 
the environment and robot sensors and actuators. We could 
also compare alternate approaches to various robot capabil- 
ities, e.g., acoustic vs. chemical communication. For in- 
stance, with more extensive use of communication, nearby 
robots could compare concentration measurements to bet- 
ter estimate concentration gradients, thereby introducing a 
spatial correlation in the state changes. Our approach ap- 
plies to these more complicated physical scenarios, but be- 
comes more computationally demanding to solve numeri- 
cally. Nevertheless, the computation cost involved to iden- 
tify useful design trade-offs through our approach will be 
less than that involved with detailed simulations (especially 
for tasks involving large populations of robots). Actual ex- 
periments with physical devices will be even more challeng- 
ing. 

Limitations of this approach are its underlying assump- 
tions, namely that to determine relevant collective swarm 
behaviors the occupancy numbers are a sufficient descrip- 
tion of the individual robots and fluctuations are small so 



the averages over many independent instances of the swarm 
are close to the actual observed behaviors in most of those 
instances. More broadly, this approach connects average, 
aggregate behavior with local robot controllers rather than 
providing specific details of individual robots. For applica- 
tions involving large populations of microscopic robots, the 
law of large numbers will ensure behaviors are usually close 
to average. 
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